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Autofocus Z Stage 
Background of the Invention 
Technical Field 

The present invention relates to automated focusing systems, in particular to 
5 extremely rapid automatic focusing of optical scanning systems. 

Description of the Related Art 
With the development of combinatorial chemistry and bioassays, automated 
imaging is becoming extremely important. A large variety of tests can be conducted with 
such systems, such as are disclosed in WO 99/08233 and WO 98/47006. Some of these 
10 tests, particularly ones based on fluorescence and reflected light, use confocal systems 
such as those disclosed in US 5,900,949. In such a system, light is applied through the 
optics of the system to excite a sample to fluoresce or phosphoresce, or simply to reflect 
the light. The resulting emitted, reflected or scattered light then is detected either through a 
separate optical system to the side of the light source, as shown in US 5,900,949, or 
1 5 through reflection or emission back through the same initial optical system as the light 
source, by way of a half-silvered mirror or di-chroic beam splitter. 

In a typical scanning system (illustrated in Fig. 1) a focused beam of light moves 
across a sample and the resultant reflected or fluorescent light is detected. A fluorescent 
system typically includes a source of light 10 at the proper wavelength, A cx , to excite the 
20 sample or a dye in the sample. This light is focused through source optics 12 and 
deflected by mirror 14 via scan lens 26 onto sample 16. Light that fluoresces or is 
reflected from the sample returns to detection optics 18 via half silvered mirror or di- 
chroic beam splitter 15. Alternatively, the emitted or fluoresced light can be detected from 
the side of the system, as shown in US 5,900,949. Light passing through detection optics 
25 18 then is detected using a CCD or equivalent element 20, the output from which is 
provided to computer 22 for analysis. Motor 24 is used to move mirror 14 to scan the 
excitation beam across the sample 16. The excitation beam, motor, optics and the rest of 
the system then are controlled by computer 22 to scan relevant portions of sample 16. 
In a true confocal system, the system will reject light that is not substantially in 
30 focus. As illustrated in Fig. 2, the light in such a confocal system typically will be 

deflected by mirror 14 through scan lens 26. A confocal system typically has a very small 
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depth of field d, as illustrated in Fig. 2. Sample 16 is in scan field 29, that is, in the depth 
of field d, for a scan across sample 16, traversing the range of scan. The focal length of 
the system is f, and the relative sizes of the values are f»d»A. The range of scan may 
vary from tens of micrometers to centimeters, depending on the system. 
5 For a truly flat and level surface in a confocal system, once the collection system 

and the sample are brought into focus, no more focusing along the +z or -z axis (up or 
down, as shown in Fig. 2) is required. If the light beam is scanned, the assumption is that 
the design of the system is such that rotation of mirror 14 does not move the light beam 
out of the nominal plane of focus, i.e., scan field 29 is essentially flat in the area where the 
10 sample is located. 

As will be apparent, the sample must be kept continuously in focus during a scan. 
One technique for doing this automatically or manually brings the sample into focus below 
a stationary focused beam, only once, and then scans the sample by moving it on an x-y 
translation stage. The distance from the sample to the objective then remains constant 
15 since the sample does not move up or down, throughout the scan. This method is used by 
several imaging manufacturers. 

Autofocus systems for optical scanners often use a half-blocked or obscuration 
technique to bring the sample into focus, such as is shown in Figs. 3 a, b, c, and described 
in detail in section 3 1.4 of the Optical Society of America's Handbook of Optics Vol. 1 (on 
20 CD-ROM), published by McGraw Hill (1996). In such a system, light 41 reflected or 

emitted from sample 16 passes through a lens 26. Most of the light passing through lens 
26 then will be directed to the detection optics for analysis, but, as shown in Fig. 1, some 
of the light will be directed by a low reflection beam splitter 40 to the autofocusing system 
42, shown in detail in the upper portions of Figs. 3a, b, c. (For clarity of illustration, beam 
25 splitter 40 is omitted from Figs. 3a, b, c.) 

If sample 16 is in focus, as shown in Fig. 3b, light 41 is collimated, so that light 47 
passing through lens 46 is properly focused on focal point 49. If sample 16 is too far from 
lens 26 (the -z direction), light 41 tends to converge too much, as shown in Fig. 3a. If 
sample 16 is too close to lens 26 (the +z direction), light 41 tends to diverge too much, as 
30 shown in Fig. 3 c. 
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In a typical autofocusing system, half of the beam of light 41 is blocked by knife 
edge 44. The remaining portion of light 41 passes through lens 46 to become light 47 and 
impinges upon photodetector 48. Photodetector 48 typically has halves A, B centered on 
the focal point 49 of the photodetector 48, with each half A, B serving as an independent 
5 detection region. 

When properly focused, as shown in Fig. 3 b, the light 47 impinges upon the center 
49 of the photodetector 48, between halves A, B, or at the very least impinges equally 
upon halves A, B. In contrast, when sample 16 is too far from lens 26, as shown in Fig. 
3a, more of light 47 impinges on photodetector portion B than on A, and similarly, as 

10 shown in Fig. 3 c, when sample 16 is too close to lens 26, more of light 47 impinges on 

photodetector A than on B. Therefore, the position of sample 16 relative to lens 26 can be 
determined by analyzing the relative signal strengths being generated by photodetector 
portions A and B. This can be done through any suitable method, but is conveniently done 
by subtracting the values of the outputs of the two portions A and B of the photodetector 

15 in circuit 5 1 to generate a Focus Error Signal (FES) 50. 

In theory, the absolute value of FES 50 is indicative of the distance by which 
sample 16 is out of focus, while the positive or negative value of FES 50 indicates the 
direction in which the sample 16 is out of focus. When sample 16 is in focus, light 47 
either impinges on photodetector center 49, or at least is equally balanced between 

20 portions A, B, with the result that the value of FES 50 is 0 and no z-axis adjustment is 

needed (it will be understood that the value need not be exactly 0 — some range around 0 
will normally be considered equivalent to 0). If more of light 47 impinges on half B of the 
detector (as shown in Fig. 3 a), FES 50 is a positive signal, indicating that the z translation 
stage is off in the -z direction, so the stage should be moved in the +z direction to bring 

25 the system into focus. If sample 16 is too close to lens 46, more light 47 hits A than B, 
and FES 50 is negative, indicating that the stage is out of focus in the +z direction, and 
should be moved in the -z direction to bring the system into focus. Z-axis translation 
stages responsive to such an FES signal in this fashion are commercially available. 

Summary of the Invention 

30 While working with new materials to hold samples, the inventors encountered 

problems with focusing the prior art systems when the sample surface itself undulates 
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significantly. As illustrated in Fig. 4, if the surface of sample 16 is not smooth, portions of 
the surface may be out of focus, even though sample 1 6 as a whole stays at the same 
distance from the lens 26. This may be true of both scanning beam and scanning stage 
systems. 

Specifically, Fig. 4 illustrates a set of DNA oligonucleotide probes 30 deposited on 
the surface of substrate 16. Such probes often are chemical systems which combine with 
immobilized clipped DNA fragments to identify the presence or absence of various DNA 
structures. 

As will be apparent in Fig. 4, there is a base height h that is the minimum thickness 
of the substrate, but there is also a variability Ah in the height of the surface of the 
substrate. Depending on the substrate used, Ah can be considerably larger than the depth 
of field d for the focused light beam 34. As a result, DNA probes 30 may be in or out of 
focus even without any vertical movement of substrate 16. 

Such substrate undulation can be minimized, but usually requires significant 
machining or use of fairly expensive materials such as silicon wafers or glass. 
Inexpensive materials, such those taught in WO 99/53319, are particularly likely to have 
such undulating surfaces, but are highly desirable for use. 

Therefore, if as shown in Fig. 4 the sample surface height variation Ah is greater 
than the depth of field d, some system must be in place to keep probes 30 within depth of 
field d or regions of the image will be blurry in a non-confocal system, or dark in a 
confocal system. Such a system must be capable of refocusing easily at different depths, 
but at the same time, the system must be extremely fast. This can be done by moving the 
focusing lens, but is more commonly done by moving the stage, which might be 
piezoelectric stage, a stage mounted to a solenoid or voice coil, or a translation stage. In 
any case, the position of the stage is responsive to the output of the computer. 

The difficulty is the number of times the system must be refocused. For example, 
to capture a 512 pixel x 512 pixel image (a frame) in five seconds, the autofocus change 
must take no more than 19 micro-seconds for autofocus from pixel to pixel (5 seconds 
divided by 512 x 512 pixels). This requires an extremely rapid autofocus system. 

The inventors recognized that in actual practice, the absolute value of the FES 
indicates the distance by which the sample is out of focus only if the sample is not too far 
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out of focus. If the sample is too far out of focus, the direction can still be determined 
from the positive or negative value of the FES, but the distance to the proper focal position 
cannot be determined accurately, because the FES becomes saturated, that is, the FES 
reaches a plateau. When the FES is saturated, the absolute value of the FES indicates only 
5 the saturation level and no longer indicates the distance to the correct focal point. The 
system or operator must then "guess" how much to move the sample to get it into focus, 
i.e., move it by some arbitrary amount. If the initial move is not far enough, another guess 
is necessary, while if it is too far, a move in the opposite direction may be needed. This 
repeated guessing severely limits the speed with which the system can refocus as it scans 
1 0 from one point to the next. 

The present invention therefore provides consistently rapid focusing by combining 
a half-blocked autofocus system with a variation in the amount of light being applied to 
the sample. 

A first embodiment of the present invention accomplishes rapid focusing by 
15 determining when the FES is ambiguous, and modifying the amount of light reaching the 
photodetector when it is ambiguous. Specifically, if the FES is ambiguous, the diameter 
or area of the beam of light is reduced by some predetermined amount. This will then 
unsaturate the FES and allow the system to move the lens or sample quickly to a position 
relatively near the optimum focus. The light beam diameter or area then can be increased 
20 back up, and final focusing done. 

A second embodiment of the present invention accomplishes rapid focusing by 
providing an additional mechanism for determining the approximate distance to the correct 
focal point. This may be done by providing a photodetector which can directly detect the 
radial offset of the light beam striking the photodetector, so the distance can be determined 
25 without relying on the absolute value of the difference between the signals on opposite 
sides of the photodetector. 

Still further, both embodiments may be combined to maximize the distance over 
which the system can quickly focus. 

With any of the above embodiments, the result is a two step process that can focus 
30 quite rapidly, and considerably more rapidly on average than done with a conventional 
half-blocked system alone. Combined with a very rapid z stage control, such as a 
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piezoelectric fast response system, and suitably rapid electronic control circuitry or 
software, the system can achieve the rapid response time desired for scanning systems. 

As will be apparent, having such a rapid autofocus will allow use of less expensive 
substrates with undulating surfaces, while at the same time allowing rapid image 
acquisition of the resulting product. 

Brief Des cription of the Drawing s 

The invention will be described with reference to the drawings, in which: 

Fig. 1 is a schematic representation of a typical prior art optical scanning system. 

Fig. 2 is a schematic representation of the scanning portion of the optical scanning 
system of Fig. 1. 

Figs. 3a, b, c, are schematic illustrations of a typical prior art half-blocked focusing 
system in different stages of focus. 

Fig. 4 is a schematic cross-sectional representation of a possible sample to be 
scanned by an optical scanning system. 

Figs. 5a, b are schematic illustrations of the half-blocked focusing system of Figs. 
3a, b, c modified according to a first embodiment according to the present invention. 

Fig. 6 is a graph of the focus error signal v. amount of defocus for the focusing 
systems of Figs. 3a, b, c and 5a, b, respectively. 

Fig. 7 is a schematic illustration of the half-blocked focusing system of Figs. 3a, b, 
c modified according to a second embodiment according to the present invention. 

Detailed Description of the P referred Embodiments 

Simply put, the inventors have recognized that the problem with the prior half- 
blocked systems arises because the FES is saturated. The present invention therefore 
provides a mechanism to reduce the area of the light incident on the photodetectors, and 
thereby extend the capture region in which the system will operate properly. 
Alternatively, the present invention provides a mechanism to measure the distance by 
which sample is out of focus by determining the radial extent of the light beam incident on 
the photodetectors. 

A first embodiment of the present invention is shown in Figs. 5a, b. In Figs. 5a, b, 
the elements analogous to those shown in Figs. 3a, b, c have been shown with the same 
numbers with a prime ('). 
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According to this embodiment of the invention, an iris 52 is added between lens 
26' and knife edge 44', preferably closer to lens 46' than to the beam splitter 40 to avoid 
interfering with the light going to the main optics 1 8. When iris 52 is dilated fully, as 
shown in Fig. 5a, all of light 47' that previously would have reached photodetector 48 in 
5 Figs. 3a, b, c, still reaches photodetector 48\ As has been recognized by the inventors, if 
sample 16' is too far out of focus, the absolute value of FES 50' will be above some 
predetermined value that indicates that FES 50' is saturated or nearly saturated. When this 
happens, computer 22* generates a light reduction signal (either digital or analog) to 
contract iris 52 to reduce the amount of light reaching photodetector 48', as shown in Fig. 
10 5b. 

The effects of providing and using iris 52 in this fashion can be shown with 
reference to Fig. 6. Response curve 60 in Fig. 6 is a graph of the strength of FES 50 (from 
Figs. 3a, b, c) versus the distance by which sample 16 is out of focus. The example in the 
graph uses a scanning lens 26 with a focal length of 5 cm, a light wavelength of 488 nm, 

15 beam diameter at the objective of 2 mm, a nominal distance from the scanning lens 26 

through the scanning optics to the lens 46 of 1 cm and the aperture at the detector lens 46 
of 2 mm, with the output of FES 50 normalized to ±1. Within a capture range 61 about 
±500 urn from the correct focal position (indicated at 0 on the graph), circuit 51 provides 
an output such that the absolute value of FES 50 is a good indicator of the distance from 

20 the correct focal position. Beyond about ±500 nm, FES 50 nears saturation and then 

saturates, and the absolute value of FES 50 no longer correctly indicates the distance from 
the correct focal position. As a result, the effective' capture range 61 for the system is 
slightly less than ±500 \xm from the correct focal position. 

Compare this to response curve 62, which is a graph of FES 50' from Fig. 5b, with 

25 iris 52 contracted so that the aperture at detector lens 46' is 1 mm to reduce by 50% the 
diameter of the beam of light 47' reaching photodetector 48' compared to the system for 
response curve 60. The capture region 63 of response curve 62 is accurate to roughly 
±2500 urn, or roughly five times the size of capture region 61. This provides a much 
broader range over which the system can determine both the appropriate direction and the 

30 amount by which the z-stage should be moved to bring the sample into focus. Once that 
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step has been made, iris 52 can be re-opened and fine focusing done using the full incident 
light beam. 

The element reducing the transmitted light need not be an iris 52 - the light 
reduction can be accomplished by any suitable mechanism, such as movable prisms or 
5 materials, such as segmented rings of liquid crystals, which can be electromagnetically 
controlled to control light transmission between sample 16* and photodetector 48*. In 
addition, while iris 52 has been shown positioned between lens 26' and knife edge 44', it 
will be appreciated that iris 52 could be positioned anywhere between sample 16' and 
photodetector 48\ However, positioning the light reduction element between lens 26' and 

10 knife edge 44' has the advantage of allowing use of the entire photodetector 48', while 
positioning it closer to photodetector 48' might block part of photodetector 48*. 

In cases where the system is extremely out of focus, it is possible that even the 
present system might not bring the system close enough to the optimum focused position 
to avoid saturation when iris 52 is reopened. This could then result in an oscillation of 

15 resolution modes, bouncing back and forth between the iris being contracted and opened. 
To prevent this, iris 52 can be driven by a stepper motor or a continuous motor set to 
permit several aperture sizes (or even a continuous variation), so that iris 52 can be moved 
from one aperture size to the next until the system is close enough to focus to accept the 
full incident light beam. Alternatively, a software hysteresis system can be used to limit 

20 successive oscillations. These techniques may require multiple steps, but would be 
preferred to attempting to do the same thing with just the classic half-blocked system. 

A second embodiment according to the invention is shown in Fig. 7. In Fig. 7, the 
elements analogous to those shown in Figs. 3a, b, c have been shown with the same 
numbers with a double-prime ("). 

25 While the halves A, B of photodetector 48 extended from the focal center 49 to the 

outer edge of the photodetector, the analogous elements in photodetector 48" shown in 
Fig. 7 are split into a series of elements A_ n , ... A-i, Ao, B 0 > B +l , B+n. Each element acts 
independently and is connected to its own FES circuit 51 A -n, . ..51 A -i, 51 A o, 51bo, 51 b+ i, 
51b+h, which in turn is connected through an analog-to-digital converter 54 to the 

30 computer 22", which controls the z-stage position. 
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With the multiple elements in photodetector 48", the offset from the center of the 
beam of light 47" incident on the photodetector 48" can be detected to a reasonable degree 
of accuracy based on the distribution of light detected by elements A_„, . .. A-i, Ao, B 0 , B+i, 
B+n. This in turn gives an estimate of the amount by which sample 16" is out of focus. 

As will be apparent, the first and second embodiments could be combined, 
providing an even broader range for the depth of field in which the system can quickly 
come to focus. 

It will be understood that these exemplary embodiments in no way limit the scope 
of the invention. Steps in the focusing process do not necessarily need to be performed 
strictly in the order described here; any order that accomplishes the same goals would 
work. Other modifications of the invention will be apparent to those skilled in the art in 
view of the foregoing description. These descriptions are intended to merely to provide 
specific examples of embodiments which clearly disclose the present invention. 
Accordingly, the invention is not limited to the described embodiments or to the use of 
specific elements, dimensions, materials or configurations contained therein. All 
alternative modifications and variations of the present invention which fall within the 
spirit and scope of the appended claims are covered. 
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Claims 

We claim: 

1. A focusing system for an optical system for imaging light from a sample, the system 
having: 

5 a) a photodetector for receiving and detecting a light beam from the sample along an 

optical path, the photodetector having at least two parts, each of which 
independently generates a light intensity signal indicative of the intensity of the 
light beam falling upon it; 

b) at least one lens in the optical path between the sample and the photodetector for 
10 focusing the light beam coming from the sample; 

c) a knife edge positioned in the optical path between the sample and the 
photodetector for blocking at least one, but not all, of the parts of the photodetector 
from receiving light from the sample; 

d) a stage for holding the sample; and 

15 e) a focus mechanism for controllably moving the at least one lens or the stage along 

the optical path in response to a focus signal to adjust the focus of the system; 
characterized in that the system further comprises: 

£) a light adjuster positioned in the optical path between the sample and the 

photodetector for controllably adjusting the area of the light beam in response to a 
20 light adjustment signal; and 

g) a controller for generating the light adjustment signal and the focus signal in 
response to the light intensity signals, by: 

i) subtracting light intensity signals from substantially opposite parts of the 
photodetector to generate a focal error signal indicative of a direction and 

25 amount by which the image of the sample is out of focus; 

ii) if the absolute value of the focal error signal is larger than a first predetermined 
acceptable value, generating a light adjustment signal to cause the light adjuster 
to reduce the area of the light beam; 

iii) generating a focus signal to cause the focus mechanism to adjust the focus of 
30 the system in the direction and by an amount sufficient to bring the focal error 

signal closer to zero. 
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2. The system of claim 1, further characterized in that the controller iterates steps (g)(i) 
through (g)(iii) until the focal error signal is below the first predetermined acceptable 
value. 

3. The system of claim 2, further characterized in that the light adjuster has multiple light 
5 adjustment positions, and steps (g)(i) and (g)(ii) are repeated until the absolute value of 

the focal error signal is below the first predetermined acceptable value. 

4. The system of any of claims 1 - 3, further characterized in that the controller generates 
a light adjustment signal to cause the light adjuster to increase the area of the light 
beam after the focal error signal is below the first predetermined acceptable value, and 

10 iterates steps (g)(i) and (g)(ii) until the focal error signal is below a second 

predetermined acceptable value. - 

5. The system of any of claims 1-4, wherein the light adjuster comprises an element 
selected from the group consisting of an expandable iris, a set of movable prisms and a 
layer of a segmented material which can be electromagnet ically controlled to adjust its 

15 transmissivity. 

6. The system of claim 5, wherein the element is an iris, and the iris is driven by a 
stepper motor responsive to the light adjustment signal, and the light adjustment signal 
is a digital signal. 

7. The system of claim 5, wherein the iris is driven by a continuous motor responsive to 
20 the light adjustment signal, and the light adjustment signal is an analog signal 

8. The system of any of claims 1 - 7, wherein the stage comprises a piezoelectric surface 
which moves closer to or farther away from the photodetector in response to the focus 
signal. 

9. The system of any of claims 1-8, wherein the photodetector has at least four parts 
25 positioned at at least two different radial distances from a center of the photodetector, 

and wherein the controller determines an amount by which the light beam is offset 
from the optical path by comparing the light intensity signals from each part of the 
photodetector. 

10. A focusing system for an optical system for imaging light from a sample, the system 
30 comprising: 
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a) a photodetector for receiving and detecting a light beam from the sample along an 
optical path, the photodetector having at least four parts positioned at at least two 
different radial distances from a center of the photodetector, each part 
independently detecting the intensity of the light falling upon it and generating a 

5 light intensity signal indicative thereof; 

b) at least one lens in the optical path between the sample and the photodetector for 
focusing the light beam coming from the sample; 

c) a knife edge positioned in the optical path between the sample and the 
photodetector for blocking at least one, but not all, of the parts of the photodetector 

10 from receiving the light beam from the sample; 

d) a stage for holding the sample; 

e) a focus mechanism for controllably moving at least one lens or the stage along the 
optical path in response to a focus signal to adjust the focus of the system; and 

0 a controller for generating the focus signal in response to the light intensity signals 
15 by: 

i) subtracting light intensity signals from substantially opposite parts of the 
photodetector to generate a focal error signal indicative of a direction in which 
the image of the sample is out of focus; 

ii) comparing light intensity signals from parts of the photodetector at different 
radial positions to determine an amount by which the image of the sample is 
out of focus; 

iii) generating a focus signal in response to which the focus mechanism will adjust 
the focus of the system in the direction and by an amount sufficient to bring the 
focal error signal closer to zero; and 

iv) repeating steps (i) through (iii) until the focal error signal is within a 
predetermined acceptable range. 

11. A method of focusing an optical system for imaging light from a sample, the system 
having: 

i) a photodetector for receiving and detecting a light beam from the sample along an 
optical path, the photodetector having at least two parts each of which 
independently detects the intensity of the light falling upon it; 
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ii) at least one lens in the optical path between the sample and the photodetector for 
focusing the light beam coming from the sample; 

iii) a knife edge positioned in the optical path between the sample and the 
photodetector for blocking at least one, but not all, of the parts of the photodetector 

5 from receiving light from the sample; 

iv) a light adjuster positioned in the optical path between the sample and the 
photodetector for controllably adjusting the area of the light beam; 

v) a stage for holding the sample; and 

vi) a focus mechanism for controllably moving the at least one lens or the stage along 
10 the optical path in response to adjust the focus of the system; and 

the method comprising: 

a) comparing the intensity of the light on substantially opposite parts of the 

photodetector to determine the amount by which and direction in which the image 
of the sample is out of focus; 
15 b) if the sample is out of focus by more than a first predetermined amount, causing 

the light adjuster to reduce the area of the light beam, and re-evaluating the amount 
by which the sample is out of focus; 
c) moving the focus mechanism in the direction and by an amount sufficient to bring 
sample closer into focus. 
20 12. The method of claim 1 1, further comprising iterating steps (a) through (c) until the * : 
sample is out of focus by no more than the first predetermined amount. 
13 The system of claim 12, wherein the light adjuster has multiple light adjustment 

positions, and the process further comprises iterating steps (a) and (b) until the amount 
by which the sample is out of focus can be determined accurately. 
25 14 . A method of focusing an optical system for imaging light from a sample, the system 
having: 

i) a photodetector for receiving and detecting a light beam from the sample along an 
optical path, the photodetector having at least four parts positioned at at least two 
different radial distances from a center of the photodetector, each of which 
30 independently detects the intensity of the light falling upon it; 
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ii) at least one lens in the optical path between the sample and the photodetector for 
focusing the light beam coming from the sample; 

iii) a knife edge positioned in the optical path between the sample and the 
photodetector for blocking at least one, but not all, of the parts of the photodetector 
from receiving light from the sample; 

v) a stage for holding the sample; and 

vi) a focus mechanism for controllably moving the at least one lens or the stage along 
the optical path in response to adjust the focus of the system; 

the method comprising: 

a) comparing the intensity of the light on substantially opposite parts of the 
photodetector to determine the direction in which the image of the sample is out of 
focus; 

b) comparing the intensity of the light from parts of the photodetector at different 
radial positions to determine an amount by which the image of the sample is out of 
focus; 

c) moving the focus mechanism in the direction and by an amount sufficient to bring 
the sample closer into focus; and 

d) repeating steps (a) through (c) until the sample is in focus. 
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